Skip to main content

View Post [edit]

Poster: Larsenv Date: Nov 27, 2020 4:18pm
Forum: software Subject: Uploading a Repository

Hi,

I am trying to upload a repository with 40K+ files.

I first tried to upload it with the ID of MarioCubeRepo (under a different account) via torrent - but Transmission messed up the torrent it created so only 96.3% of it could be seeded. Thus, it is stuck deriving. I tried deleting the upload but it wouldn't work. None of the files uploaded from the torrent show up.

I then tried to upload it with the internetarchive Python library with the ID of MarioCube_Repo, but it seems to keep getting automatically deleted because of a malware check.

How can I get my data uploaded to Archive.org? Maybe what was in the torrent could be kept since that is already uploaded? I think Jeff could maybe help? (I've seen him around here) The derive would just need to be stopped and get the so-called "malware" removed from it.

Thanks. This post was modified by Larsenv on 2020-11-28 00:18:30

Reply [edit]

Poster: Jeff Kaplan Date: Nov 27, 2020 6:14pm
Forum: software Subject: Re: Uploading a Repository

the derive task was paused. the item is going to be made dark based on the following tasks. the tar files is over 500GB which is what we recommend as the maximum.

Reply [edit]

Poster: Fionera_ Date: Nov 27, 2020 6:32pm
Forum: software Subject: Re: Uploading a Repository

Thanks. What do you mean by "make dark"? Does that mean the item won't be public? I don't want to have the item be deleted. I want the item to be public, that was why I uploaded it.

Reply [edit]

Poster: Jeff Kaplan Date: Nov 27, 2020 10:02pm
Forum: software Subject: Re: Uploading a Repository

yes. you queued that task. see https://catalogd.archive.org/history/MarioCubeRepo

i'd need to wait for all the tasks to run to bring it back online.

Reply [edit]

Poster: Fionera_ Date: Nov 28, 2020 11:30am
Forum: software Subject: Re: Uploading a Repository

The tasks seem to all have finished, so are you able to bring it back online?

Reply [edit]

Poster: Jeff Kaplan Date: Nov 28, 2020 6:00pm
Forum: software Subject: Re: Uploading a Repository

it is back online at https://archive.org/details/MarioCubeRepo

Reply [edit]

Poster: Fionera_ Date: Nov 28, 2020 6:21pm
Forum: software Subject: Re: Uploading a Repository

Is it possible the files out of the tar.gz can be extracted so people can download individual files? I don't think people would enjoy downloading a large 600GB file.

Reply [edit]

Poster: Jeff Kaplan Date: Nov 28, 2020 8:24pm
Forum: software Subject: Re: Uploading a Repository

not with gz format. if it was a zip or regular tar they'd be able to navigate inside and download individual files.

Reply [edit]

Poster: Fionera_ Date: Nov 28, 2020 9:47pm
Forum: software Subject: Re: Uploading a Repository

In order for the contents to be more easy to browse, I would be willing to reupload the item.

Is there any way to check the items for malware before uploading? It seems some files in the collection are being deemed malware and it's making it hard for me to upload much before the item is deleted.

Reply [edit]

Poster: Jeff Kaplan Date: Nov 29, 2020 3:45pm
Forum: software Subject: Re: Uploading a Repository

i'm not seeing that malware was detected for what you already uploaded to that item.

Reply [edit]

Poster: Fionera_ Date: Nov 29, 2020 5:21pm
Forum: software Subject: Re: Uploading a Repository

Please check with the IDs MarioCube_Repo or MarioCubeRepo1. I uploaded those with another account and it almost immediately gets removed because it thinks it's malware.

I want a way to check all the files before uploading.

Reply [edit]

Poster: Jeff Kaplan Date: Nov 29, 2020 6:03pm
Forum: software Subject: Re: Uploading a Repository

these were flagged:
MarioCube_Repo/Datel and RVT-H Disc Images/FreeLoader/Wii/Datel.Freeloader.JPN.Wii-EXTRAS.zip
MarioCubeRepo1/Datel and RVT-H Disc Images/FreeLoader/Wii/Datel.Freeloader.JPN.Wii-EXTRAS.zip

it does not specify what inside the zip was malware so cant be more specific than that.